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Abstract 

For a general time-dependent linear competitive-cooperative tridi- 
agonal system of differential equations, we obtain canonical Floquet in- 
variant bundles which are exponentially separated in the framework of 
skew-product flows. Such Floquet bundles naturally reduce to the stan- 
dard Floquet space when the system is assumed to be time-periodic. 
The obtained Floquet theory is applied to study the dynamics on the 
hyperbolic omega-limit sets for the nonlinear competitive-cooperative 
tridiagonal systems in time-recurrent structures including almost pe- 
riodicity and almost automorphy. 
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1 Introduction 



In this paper we study the dynamical properties of systems of differential 
equations with a tridiagonal structure. To be precise, this refers to systems 
of the form 

Xl = fl{t,Xi,X2), 

Xi = fi{t,Xi-i,Xi,Xi+i), 2 <i <n-l, (l.l) 

We assume the nonlinearity / = (/i, /2, ■ ■ ■ i fn) is defined on M x R" and 
C^- admissible, i.e. / together with its first derivatives with respect to x = 
{xi,X2,--- ,Xn), is bounded and uniformly continuous on M x X for any 
compact set K C M". For the interpretation of ([171]) . one can think of a 
hierarchy of species xi,X2 - ■ ■ , x„, where Xi is the density or biomass of the 
ith species. In this hierarchy, xi only interacts with X2, Xn only with a;^— i, 
and for z = 2, • • • ,n — 1, Xi interacts with and Xj+i. Such a hierarchy 
may occur in the water column of an ocean or on a steep mountain side 
or on island groups, where each species dominates a species zone (depth, 
altitude or different island) but is obliged to interact with other species in 
the (narrow) overlap of their zones of dominance. 

Our key assumption about the tridiagonal system ffTTT]) is that the vari- 
able Xj+i forces well as Xi forces Xj+i, monotonically in the same 
fashion. That is, there are > and 6i £ {— such that 

(F) 6ij^{t,x)>eo, 6i^^{t,x)>eo, l<i<n-l, 
oxi+i dxi 

for all (t,x) G M X M". If 5i = —1 for all i, then ([TTT]) is called competitive. 
If = 1 for all i, then ([TTT]) is called cooperative. Here we do not allow 
predator-prey relationship (see, e.g. pj). 

We introduce new variables, following Smith [28]. Let Xi = fiiXi,fii E 
< i < n, with fii = = Then the system ffTT]) 

transforms into a new system of the same type with new 

Si = fJ'ifJ'i+A = fJ-i^i = 1- 

Therefore we can always assume, without loss of generality, that the trdiag- 
onal system ([TTT]) is in fact cooperative, which means that 

-{t,x) > eo, ^^(t,x) > eo, 1 < i < n-1, {t,x) £ MxM". (1.2) 



dxi+i dxi 
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In particular, if the system ffTTT]) + f[TT^) is linear, we write the corresponding 
system as the following form: 

xi = anit)xi + ai2(t)x2, 

Xi = ai^i^i{t)xi^i + aii{t)xi + aiA+i{t)xi+i, 2 < i < n - 1, (1.3) 

Xn — (2}2^n— 1 (^)^n— 1 ~l~ O'nnii^Xn, 

where aj.j+i(t), aj+i^j(t) > eo, for all t G M and 1 < i < n — 1. 

When the linear system (jiT^j) is time-periodic in t, Smith [28j studied 
the Floquet theory by using an integer- valued Lyapunov function a, first 
defined by Smillie |27] (see also similar forms by Mallet-Paret and Smith 
[16] and Mallet-Paret and Sell [II]), and related the values of a to the 
Floquet multipliers for such linear perodic system. This function a is only 
continuously defined on an open and dense subset A of M" (See section [2]). 
However, a is well defined for all but an at most finite set of points t along a 
nontrivial solution of the linear system (jiT^j) > is locally constant near points 
where it is defined, and strictly decreasing as t increases through points 
where it is not defined. As a consequence, in a certain sense, a can be seen 
more or less as the discrete analog (although a still possesses somewhat 
difference) of zero-crossing number of Matano [13] (discovered originally by 
Nickel [I?]) for scalar reaction-diffusion equations. By utilizing the zero- 
crossing number, Chow, Lu and Mallet-Paret @] have already established 
the Floquet theory for linear periodic scalar parabolic equations. 

In the first part of the present paper, we will develop a Floquet theory for 
a general linear time-dependent system of ( [TT^ , and we express this theory 
in the language of invariant vector bundles and the so-called exponential 
separation (see, e.g. [13 dSl [TO] and references therein). Our approach is 
fully motivated by the work of Chow, Lu and Mallet-Paret [H [5] for time- 
dependent scalar parabolic equations, and extends earlier work on linear 
autonomous equations in [27] and linear time-periodic equations in [28] . 

Concretely, for each 0<m<n — 1, we associate with a nontrivial so- 
lution Xmit) of (ji^j) (unique up to constant multiple) with Xmif) G A and 
a{xm{t)) = for all i G M. These solutions are then treated as a base to de- 
couple ( [TT3] ) into a system of one-dimensional ordinary differential equations. 
Moreover, if one writes Wm as the one-dimensional span of Xm(0), we can 
show that Wm varies continuously with respect to the coefficients of (jiTjj) 
in certain appropriate topology, and hence, Wm{-) forms a one-dimensional 
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vector bundle (called Floquet bundle of (ji^j)) over a proper product space, 
which will be indicated explicitly later. Moreover, the exponentially sep- 
arated property is admitted between the various time-dependent Floquet 
bundles, by which one can obtain a more delicate decomposition of invariant 
bundles than those induced by Sacker-Sell [201 EI] for linear skew-product 
flows. 

The Floquet bundles obtained here are analogous to ones obtained in [5] 
for time-dependent scalar parabolic equations. However, as the function a 
is only defined (continuously) on A, not on the whole M" \ {0} (while the 
zero-crossing number can be defined on the whole phase space X except 
for {0}), it needs more delicate and technical trick to construct the Floquet 
bundles. Moreover, among other things, one may also run into difficulties 
when dealing with the phase-points at which the integer-valued Lyapunov 
function strictly decreases. For zero-crossing number, it entails that such a 
phase-point, say u ^ X, possesses a multiple zero, and hence, one can employ 
the standard characteristic of ti(^) = Ux{C) = 0) foi^ some ^, to analyze 
such critical situation (see the detail in [5l Corollary 4.8 and Theorem 5.1]). 
In our case, the critical point occurs at x ^ A. Nevertheless, there is no 
similar useful characteristic of such a critical point; and for example, this 
is indeed the situation we encounter (see, e.g. Proposition 12.41 below), in 
which we are trying to show the linear property of the Floquet space. We 
overcome such difficulty by constructing a pair of so called relevant-sequences 
simultaneously and accomplish our approaches by analyzing the convergent 
property of one of such relevant-sequences. 

It is well known that the linear theory of invariant bundles plays a crucial 
role in the study of qualitative properties of nonlinear differential equations. 
In the second part of this paper, we will investigate the nonlinear tridiagonal 
system ([1:1]) + (fiT^) via the Floquet theory developed in the first part of our 
paper. 

To be more specific, we embed ([TTT]) into the skew-product fiow Ilf : 
M" X H{f) ^ R" X H[f), 

nt(xo, 5) ^ (7r(t, xo, g),g -t), 
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where TT{t,XQ,g) is the solution of 
xi = gi{t,xi,X2), 

Xi = gi{t,Xi_i,Xi,Xi+i), 2<i<n-l; 

with iT{0,xo,g) = xq e W, and g = {gi,--- ,gn) G H{f), {g-t){-,-) = 
g(t + •, •). Here 

H{f) ^ cl{f • r|T G M, / • T{t, u) = fit + T, u)} 

is called the hull of /, where the closure is taken in the compact open 
topology (see [23]). Obviously, vr satisfies the cocycle property, i.e, 7r(t + 
s, X, g) = 7r(s, nit, x, g),g ■ t), for all s, t G M and g G H{f). 

Since / is C^-admissible, the time-translation flow g ■ t on H{f) is com- 
pact. Here we further assume that the flow on H{f) is even recurrent or 
minimal. This is satisfled, for instance, when / is a uniformly almost pe- 
riodic, or, more generally, a uniformly almost automorphic function (see 
Definitions 112]). 

In |29j , one of the present authors has shown that any minimal invariant 
set of Ht is an almost 1-cover of H{f) (see definitions in Section S]), and 
every tj-limit set uj{x,g) of Hj contains at most two minimal sets. Moreover, 
it was also shown in [29] that if the w-limit set is distal or uniformly stable, 
then it is a 1-cover of H{f). 

Inspired by the series work of Shen and Yi [251 126] . we will utilize the 
obtained Floquet theory to improve the lifting property of the cj-limit sets 
which are hyperbolic (see Definition 14.41 and Theorem 14. 5p . i.e. any hyper- 
bolic cj-limit set is also a 1-cover of H{f). 

Our results here are natural generalization of the results of Smillie |27] 
and Smith [28] . Moreover, in a certain sense, our results also extend to higher 
dimension (n > 3) the results in spatially homogeneous cases by Hetzer and 
Shen [8J, who investigated the dynamics of two-dimensional competitive or 
cooperative almost periodic systems. In particular, for 2-D competitive or 
cooperative almost periodic systems, we have obtained that any hyperbolic 
cj-limit set is exactly a 1-cover of the base H{f) (see Corollarv 14. 6p . This 
generalizes the results of de Mottoni and Schiaffino |16J and Hale and So- 
molinos [6], who proved that all solutions of two-dimensional T-periodic 
competitive or cooperative systems are asymptotic to T-periodic solutions. 
See also [9] and [23] for extensions of this work. 
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The paper is organized as follows. The Floquet solutions and spaces of 
system ( [TT^ are constructed in Section 2 by taking certain limits of peri- 
odic linear tridiagonal systems. Moreover, we also relate the values of a to 
the Floquet solutions, and decouple ([T^]) into a system of one-dimensional 
ODEs. In section 3, we define the Floquet bundles and prove the result- 
ing exponential separations between these invariant bundles in the language 
of the skew-product flow. Finally, we focus on nonautonomous nonlinear 
cooperative-competitive tridiagonal ODEs in Section 4; and study the lift- 
ing properties of hyperbolic omega-limit sets by using the Floquet Theory 
obtained in the previous sections. 

2 Floquet Solutions and Spaces 

In this section, we focus on the linear tridiagonal system (jiTjj), with all 
the coefficient functions being bounded and uniformly continuous on M. 
Moreover, we assume that aj^j_|_i(t), ai+i^i(t) > for all t G R and 1 < 
i < n — 1. Hereafter, we write the corresponding coefficient matrix A(t) = 
{aij{t))nxn- It is easy to see that matrix-valued function A{t) is tridiagonal 
and cooperative. 

We will build up Floquet solutions and spaces for the general time- 
dependent linear system (ji^j). Following [271 [28], we define a continuous 
map 

a: A^{0,l,2,...,n-1} 

on A = {x G M" : xi 7^ 0, x„ 7^ and if Xj = for some i, 2 < i < 
n — 1, then Xj-iXj+i < 0} by 

a{x) = : Xi = or XjXj+i < 0}. 

Here # denotes the cardinality of the set. Note that A is open and dense in 
and A is the maximal domain on which a is continuous. 

Lemma 2.1. Let x{t) be a nontrivial solution of system ( pT^ . Then 

(i) x{t) G A except possibly for isolated values of t; 

(ii) (j{x{t)) is nonincreasing as t increases with x{t) G A. Moreover, if 
x{s) ^ A for some s G M then a{x{s+)) < a{x{s—)); 

(iii) x{t) G A and a{x{t)) is a constant for t sufficiently positive (resp. 
negative). 
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Proof. See [281 Proposition 1.2] for the proof of (i) and (ii). By virtue of (i) 
and (ii), (T{x{t)) can drop only finite times, which imphes (iii). □ 

When A{t) is periodic in t with period T, the Floquet multiphers of ( fTT^ 
have the following property. 

Lemma 2.2. (i) The T-periodic system (jiTjj) has n distinct positive Flo- 
quet multipliers ao,ai, . . .,a„_i, satisfying 

ao > ai > . . . > a„_i > 0; 

(ii) // are the corresponding one- dimensional eigenspaces associated 
with am then \ {0} C A and 

<E^^ \ {0}) =m, 0<m<n-l; 

(iii) Fix < m < n — 1, there exists a solution Xm{t) such that 

a{xm(t)) = m, for t G M. 

Proof. For (i) and (ii), see \28\ Theorem 1.3]. We only prove (iii). Fix 
< m < n — 1. Note that am is a positive number. By the standard 
Floquet theory, there exists a nontrivial solution of ([TTjj) 

Xmit) = e^"^^pm{t), 

where fim = Inom and Pm{t) is a T-periodic function withpm(O) G Ea^\{0}. 
Since pm{kT) = Pm{0) G Ea^\{0}, (ii) implies that pm{kT) G A and 
o'iPmikT)) = m for all G Z. Combined by Lemma 12.1^ 111). we readily 
get Xmif) £ A and a{xm{t)) = m for all |t| sufficiently large. Then by 
Lemma 12.1( 11). we have Xm{t) G A and cr{xm{t)) = m for all i G M, which 
completes the proof. □ 

The following proposition shows that Lemma I2.ir iii) can still hold for 
the general time-dependent system ( [TT^ . 

Proposition 2.3. For each < m < n — 1, there exists a solution Xm{t) of 
( fTTBi ) satisfying 

a(xm{t)) = m, for all t G ffi. 
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Proof. We begin by constructing a sequence of continuous matrix-valued 
functions where 

{t + k + l)A{-k) if -k-l<t<-k, 
Akit) = I A{t) if -k<t<k, 

^ {k + l-t)A{k) ifk<t<k + l, 

on [—k — l,k + l]; and moreover through a standard practice one can extend 
74fc(t) to a 2{k + l)-periodic function on M. It is easily seen that {Ak{t)}'^^ 
is uniformly bounded and Ak{t) converges to A(t) uniformly on any compact 
set in M. 

For each A: > 1, consider the 2{k + l)-periodic equation 

X = Ak{t)x. 

Note that Ak{t) is of cooperative tridiagonal form. Then Lemma I2.2l fiii) 
implies that for each < m < n — 1, there exists a solution Xm\t) defined 
on M such that 

C7(a;(^)(t)) = m, for aU t € M. 

We normalize these solutions so that the initial points satisfy |xm''(0)| = 1. 

Fix < m < n — 1 and consider the sequence {xm{0)}'^=i- Then there 
exists a subsequence {k'} such that Xm \o) Vm, with \ym\ = 1, as k' oo. 
Recall that {Akr{t)} is uniformly bounded and tends to A{t) uniformly on 
any compact interval. By virtue of Grownwall inequality, the corresponding 
solution Xm{t) of equation ( [TT^ with initial values Xm(0) = ym satisfies that 
Xm \t) — 7- Xm{t) uniformly on any compact interval as k' oo. 

We claim that Xm{t) G A and a{xmit)) = m for all t G M. Indeed, by 
Lemma [TTT iii) ■ one can find a to > 0, such that Xm{t) € A and (j{xm{t)) = 
Ni (resp. N2) for all t > to (resp. t < —to). On the other hand, using the 
openness of A and liuik-^oo Xm\'to) = Xm{to), we obtain that (7{xm\to)) = 
Ni and cr(xm\—to)) = N2 for all k sufficiently large. It then follows from 
Lemma l2.2r iii) that 

Ni = N2 = m for ah t G M, 

which implies that Xmit) € A for all t G M. This completes the proof. □ 

For integers 0<m</<n — 1, we define the set 

Wm,iiA) = jx £ R" \ |0||the solution x{t) of ([r:^ with x(0) = x 
satisfies m < a{x{t)) < I, whenever x{t) € A} U {0}. 
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Clearly, Proposition 12.31 implies that Wm,i{A) is a nonempty set. Moreover, 
we have 

Proposition 2.4. The set Wm,ii^) is a linear subspace ofW"; and 

dim{Wm,i{A)) =l-m + l. 

Proof. Take xo,yo S Wm^iiA). Let x{t) and y{t) are nontrivial solutions of 
(jr^j) with x(0) = xq, y{0) = yo such that m < a{x(t)), a{y{t)) < I, whenever 
x{t),y{t) £ A. Since a{ax) = a{x) for any x G A and a 7^ 0, it suffices to 
show that 

m < a{x{t) + y{t)) < I, whenever x{t) + y{t) £ A. 

We only prove the upper bound I, as the proof of the lower bound is similar. 

To this end, by (ii)-(iii) of Lemma [2. H suppose that there exists a to ^ 
such that 

x{t) + y{t) G A and a{x{t) + y{t)) > /, for ah t < to. (2.1) 

Since A is an open set, there exist a 5o £ (0, 1) such that for any 6 G [0,(^0]) 
x{to) + (1 - 6)y{to) G A and a{x{to) + (1 - d)yito)) = cT(x(to) + y(to)) > I 
For each 6 G [0, 5o]) since x{t) + (1 — 6)y{t) is a solution of (jiTjj), Lemma 
I2.1l fii-iii) implies there exists a < to such that, 

a{x{t) + (1 - S)y{t)) > I, for all t < ts. (2.2) 

Now, let us fix a (5 G (0, 5o]. By virtue of ([XT]) and one can choose 

a sequence {tfcjfcLi, satisfying mm{to,ts} > tk ^ —00, such that 

a{x{tk) + (1 - 6)y{tk)) > I and a{x{tk) + y{tk)) > I, 

for all > 1. Recall that Xo,yQ G Wm,iiA.), one may further assume that 
o'{x(tk)),o'(y{tk)) < / for all k >1. Consequently, for each k >1, there exist 
6i{tk) G (0, 1 - S) and (^2(tfc) G (0, 1) such that 

x{tk) + 6i{tk)y{tk) i A and 52{tk)x{tk) + y{tk) i A. 

Now we define the following pair of relevant-sequences 

~ ^ x{tk) + h{tk)y{tk) ^ ^ S2{tk)x{tk) +y{tk) 

\x{tk)\ + \y{tk)\ "^"^ \x{tk)\ + \y{tk)\ 
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Clearly, Zk,Wk ^ A for all k > 1. Take a subsequence of {tk} if necessary, 
we may also assume that ^ z„ \^(t,f+\y{t,)\ ^ ^ 

(5i* G [0, 1 — (5] and 52{tk) — >■ ^2* G [0, 1], as n ^ oo. Then one obtains that 
Zk Z:t + 6ww^ = ^ A and Wk — ^ 62*z^ + w^ = tw^, ^ A as A; — )• oo, because 
A is an open set. Moreover, the vector {z^,w^) ^ (0,0), since < 5i* < 1 — 5 
and < 62* < 1. (Otherwise, it follows that {z^,,w^) = (0,0), which yields 
1 = HtifAy(t,)\ + | xfa)|+ | ifa)| ^ 1^*1 + 1**1 = 0, a contradiction.) 
Without loss of generality, we now assume that z^, 7^ 0. For each A; > 1, 

let 



Wk)\ + \y{tk)\ 
Clearly, z^^ {t) is a nontrivial solution of the equation 

X = At^ {t)x = A{t + tk)x, 

with the initial value ztf^{0) A; — >■ 00. Recall that A{t) is 

bounded and uniformly continuous on M. Then one can find a subsequence, 
still denoted by {t^}, such that ^t^(t) converges to A^,(t) uniformly on any 
compact interval as A —> 00. Let z^(t) be the nontrivial solution of i; = 
A^:{t)x with the initial value 2:*(0) = 7^ 0. Then by Lemma 12.51 below, 
one can deduce that 2:*(s) G A and a{z^{s)) = const for all s E M. Li 
particular, = z*(0) G A, a contradiction. Thus we have proved that 
Wm,iiA) is a linear space. 
Next we note that 

{0} c Wo,o{A) c Wo,i{A) c . . . c Wo,n-i{A), 

due to the definition of Wm,i{A) and Proposition 12.31 Since Wo^i{A) is a 
linear space, in order to prove dim(Wm,K^)) = ^ — "m. + 1, it suffices to show 
that dim(VFo,z(^)) = / + 1 for each < ^ < n - 1. 

Note that Wk,k{A) C Woj{A) for all < A < / and the solutions 
Xk{t) € Wk,k{A), obtained in Proposition 12.31 are linearly independent. 
So, dim(VFo,i(^)) > / + 1 (Otherwise, one may find some < A < / with 
Xk{t) = aoxo(t) + • • • + ajt_iXfc_i(t), which implies that Xk{t) G Wo^k-iiA), 
contradicting that Xk{t) £ Wk^kiA)). On the other hand, suppose that 
dim(Wo,i(^)) > / + 1. Then by induction one can deduce dim(Wo,n-i(^)) > 
n, which contradicts the fact dim(Wo,n-i(^)) = n. Thus we have proved 
that dim(Wo,«(^)) = ^ + 1- □ 



10 



Lemma 2.5. Let A{t) be in (jiT^j) and he the time r-shift of A, that is 
Arit) = A{t + r). Let also x{t) be a nontrivial solution of ( [TT^ . If there 
exists a sequence ^ oo (or tk ^ —oo) such that x{tk) ^ x* 7^ and At^, 
converges to uniformly on any compact interval o/M, then the solution 

x*{t) of X = A:f,{t)x, with initial value j;*(0) = x*, satisfies 

x^{t) G A and cj(x*(t)) = const, 

for any t € M. 

Proof. For each t^, we first note that x{t + tk), t € M, is a nontrivial solution 
of X = Atf.{t)x. It then follows from Grownwall inequality that x{t + t^) 
tends to x*(t) uniformly on any compact interval. So for any s G M with 
G A, the continuity of cr implies that 

f7(x*(s)) = lim a{x{s + tn)) = Ni, (2.3) 

where the last equality is due to Lemma [2.1f iii). By the assumption on A{t), 
it is easy to see that Lemma |2 . 1 1 holds for the solution x^,(t) of the equation 
x = A^{t)x. Therefore, (js^j) yields that x^,(t) G A for any t G M, and hence 
(T(x*(t)) = const for all t G M. □ 

Remark 2.6. By Proposition 12.41 for each < m < n — 1, the solution 
Xmif) obtained in Proposition 12.31 is unique up to a constant multiple. As 
a consequence, we can normalize x^n (t) so that |xm(0)| = 1 and the first 
coordinate of Xm(0) is positive. Hereafter we always use these normalized 
solutions in the following context. 

We call the spaces {Wm,«(^)}o<m<«<n-i and these normalized solutions 
{xm(i)}o<m<n-i, Floquct spaccs of (jiT^j) and Floquet solutions of (jiTjj), re- 
spectively. 

3 Floquet Bundles and Exponential Separation 

Based on the results obtained in previous section, we study in this section 
the following differential equations with parameter y (^Y: 

x = B{yt)x, x€W,yeY, (3.1) 

where y ■ t defines a flow on a compact metric space (1", d) , and B is a 
continuous matrix-valued function on Y. Moreover, B{y) is assumed to be 
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cooperative tridiagonal for each y £Y. Moreover, we denote by ^(t,y) as 
the principal fundamental matrix solution of ( jg7T| . 

By Proposition 12.41 and Remark 12.61 one can obtain the Floquet spaces 
^/,m(y) and solutions x„i{t,y) associated with each y £Y, where < / < 
m < n — 1. For brevity, we hereafter use the short notations Wkiy) and 
Xm{y) instead of Wk,kiy) and Xm{0,y)- 

Proposition 3.1. For 0<l<m<n — 1 and y , we have 

(i) Wm{y) = span{xm{y)} and Wi^m{y) has the direct sum decomposition 

Wi^M = ®T=iWk{yy, 

(ii) ^it,y)Wi^M = Wi^miy ■ t), for all t G R; 

(iii) Wi^rn{y) varies continuously with y £Y as a subspace o/M". 

Proof, (i) This is a direct corollary of the proof of Proposition 12.41 

(ii) Due to (i), it suffices to show that, for each < A; < n — 1, 
^it,y)Wkiy) = Wkiy ■ for ah t G M. Since Wk{y) = span{xfc(y)}, we 
only need to prove that Xk{t, y) £ Wk{y -t). To see this, fix f G M, note that 
both Xk{t + s, y) and Xfc(s, y ■ t), as functions of s, are nontrivial solutions of 
X = B(y ■ [t + s))x. Moreover, noticing a{xk{s, y ■ t)) = k = a{xk{t + s, y)) 
for all t G M, it then follows from Remark 12. 61 that there exists a real number 
C 7^ such that 

Xk{t + s,y) = Cxk{s,y ■ t) for all s G M. (3.2) 

By letting s = 0, we have Xf^{t,y) = Cxk{0,y • t) G W^iy • t). 

(iii) We only need to prove Xm (y) is continuous with y G y as an element 
of M", for each < m < n — 1. Fix < m < n — 1 and let yk ^ y in Y. Then 
^iUk 't) converges to B[y-t) uniformly for t in any compact interval. Given 
any subsequence k' satisfying Xm{yk') x^^^as k' 00), by Grownwall 
inequality again, one has Xm{t,yk') converges to x{t,y) uniformly for t in 
any compact interval, where x{t, y) is the solution of 

X = B{y ■ t)x, 

satisfying x{0,y) = x*, with = 1 and (x*)i > (because Xmiy'k)! > 
from Remark 12. 6|) . Moreover, since a{xm{t,y'k)) = m for all t G M, we 



12 



apply Lemma l2. II to x{t,y) and obtain that a{x{t,y)) = m for all t G M. It 
then follows from the statement of uniqueness in Remark 12.61 that x{t,y) = 
Xm(t, y) for all t G M, which implies that Xm(y^) ~^ (0, y) = Xm{y) as 

k' — > oo. By arbitrariness of {k'}, one has Xmiyk) — ^ Xm{y) as A; — )■ oo. This 
completes the proof. □ 

Remark 3.2. As a matter of fact, one can further obtain that C = \xk{t,y)\ 
in ( [3:2] ). Indeed, since {xk{0,y ■ t))i > 0, {xk{0,y))i > and Xk{t + 
s, y),Xk{s, y • t) € A for all t, s € M, it entails that {xk{t + s, y))i, {xk{s, y ■ 
t))i > for all s G R, and hence C > 0. Moreover, C = \xk{t,y)\, because 
\xk{0,y • t)| = 1. As a consequence, 

x,{s,yt) = ''f^/\y\ foran.GM. (3.3) 
\xk[t,y)\ 

Now let us define the linear skew-product flow tt : M x M*^ x y — )■ M" x y, 
associated with system ( jgTT] ) as 

Tr{t,x,y) = {<l>{t,y)x,y -t). (3.4) 

For each < m < I < n — 1, we write Wm,i{y) = ^y€YWm,i{y) x {y} and 
call them Floquet bundles. Clearly, by Proposition 13.11 these bundles are 
TT-invariant and m < a{x) < I, whenever x G Wm,iiy) fl A, y G y. Moreover, 
it is easy to see that x y = Wo,k{Y)®Wk+i,n^iiY), where < A; < n-2. 
In the following, we give the definition of exponential separation between 
invariant bundles (see [151 IISl El] and references therein) . 

Definition 3.1. The ordered pair (Ai, A2) of complementary invariant sub- 
bundles of M" X y is said to be exponentially separated for vr if there exist 
positive numbers K and such that 

\<^>{t,y)x2\ ^ 



<Ke-''\ t>0, (3.5) 



\<^{t,y)xi\ 

for all y G y and xi G Xi{y), X2 G X2{y) with \xi\ = \x2\ = 1. 

We now present the first main theorem in this section. 

Theorem 3.3. For each < m < n — 2, the pair of invariant subbundles 
{Wo^m{y),Wm+i,n~i{Y)) is exponentially separated for tt . 
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Before we start to prove this Theorem, we need some basic conceptions 
and definitions. 

Given a pair of (X, X) of complementary invariant subbundles of x Y. 
For any y G y, denote by n(y) (resp. n(y)) the projection of M" on X{y) 
along X{y) (resp. on X{y) along X{y)). In particular, for each < m < n—2 
and the bundle pair (Wo^rniy),Wm+i,n~iiY)), we write as Ilmiy) (resp. 
nm(y)) the projection mapping n(y) (resp. n(y)). 

For any xi,X2 G M"\{0}, define the equivalence relation xi ~ X2 if and 
only if xi = ax2 for some a G M with a ^ 0. The equivalence class of x will 
be denoted by [x]. Then the linear skew-product flow vr on M" x Y induces 
in a natural way a projective flow Pvr : M x RP^^^ x F — )• RP^~^ x y as 

(t, ^ ([$(t,y)x],yt), 

where RP^~^ is the real (n — l)-dimensional projective space (see e.g. |22j). 

Let M C RP^~^ X y be a closed invariant subset of Pvt. M is called a 
uniformly positive attractor if it has a neighborhood Uq (called attracting 
neighborhood) such that, for any neighborhood V of M, there is a T > 
such that P7r(t, Uq) C F for ah t > T. 

If is a vector subbundle of M" x Y, then we denote by ¥W the projec- 
tive subbundle associated with W. Moreover, the cone of angle h > about 
W is the set 

K{W, h) = {{x, y) G M" X y I |n(y)x| < h\Il{y)x\]. 

If we put ¥K{¥W,h) = {{[x],y) G RP''-^ x Y \ (x,y) G K{W,h),\x\ / 
0}, then {P/i:(PW;/i) : /i > 0} is a base of the neighborhoods of ¥W in 
^pn-i X Y (See [2J). 

Lemma 3.4. Let vr : M x M" x y ^ M" x y 6e i/ie skew-product flow defined 
((231) ■ ordered pair (X, X) o/ complementary invariant subbundles of 
R" X y is exponentially separated if and only if ¥X is a uniformly positive 
attractor for the flow Pvr on RP^^^ x Y. 

Proof. See Lemma 3 in [2]. □ 

The following lemma shows the uniqueness of exponential separation. 

Lemma 3.5. If the ordered pairs (Xi,Xi) and {X2,X2) of complementary 
invariant subbundles o/M" x Y are exponentially separated and dim(Xi) = 
dim(X2). Then 

Xi = X2 and Xi = X2. 
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Proof. See ^ Lemma A. 4]. □ 

Proof of Theorem \ 3. !IA Take any ([xo],yo) G IPW^,m- It follows from Lemma 
I2.1l that there is a r > such that $(t, yo)xo € A and (T(<I>(r, yo)xo) < m. So, 
one can find a neighborhood V of (xq, yo); with its closure V C (M"'\{0}) xy, 
such that ^{T,y)x € A and (t(<I>(t, y)x) < m for all {x,y) G Moreover, 
one has 

lim a{^{t,y)z) < m, for all z G [x] and {[x],y) G 

t— >oo 

By compactness of PVFo.m, we collect a finite neighborhoods {Pl/j}^^]^ cov- 
ering FWo^rn in X Y, and denote their union by V = Ui=i IP^i- Then 

lim a{^{t,y)z) < m, for all z G [x] and {[x],y) G V. (3-6) 

Since {P-fC(PWo,m, /i) | /i > 0} is a base of the neighborhoods of PWo,m5 one 
can choose some small /iq > such that 

FK{FWo,m, ho) c V, 
and hence (I3.6P is satisfied for all z G [x] and ([x],y) G ¥K(FWo^m, ho). 



We claim that FK{FWo^rm ho) is attracting neighborhood of FWo^rn- In 
fact, by [21 Lemma 1], one only needs to show that given any ([x],y) G 
FK{FWo,m, ho) and any e > 0, there is a T = r([x], y, e) > such that 

{^{t, y)x, yt)G K{Wo,m, e), for all t > T. 

To this end, suppose that there are some ([xq], yo) G FK{FWo^m, ho), eo > 
and tn ^ 00, satisfying 

\Iljniyo ■ tn)^itn,yo)xo\ > £o\^miyO ' tn)^itn, yo)xo\- (S-j) 

Without loss of generality, we may assume that yo • in y* and — ^ 
x=K 7^ 0. Similarly as the argument in the proof of Lemma [2.5l we obtain that 
C7($(t, y*)x*) = m* for all t G M, which implies that cr(x*) = m*. Noting 
that o"(x*) = liuin^oo (^{^itn,yo)xo), ( |3.6p implies that m* < m, and hence, 
IIm(y*)a^* = 0. 

On the other hand, by letting i„ — )■ 00 in ( j^TTj ), it yields that 
|IIm(y*)a:*| > eo|IIm(y*)a;*|. 
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It then entails that JIm{y*)x* = Ilmiy*)x* = 0, which means that = 0, 
a contradiction. Thus we have completed the proof of the claim. Conse- 
quently, ¥Wo^ ra is a uniformly positive attractor of the flow Pvt. Lemma 
13.41 then implies that the {WQ^rn{X)-,Wrn+i,n-i(X)) is exponentially sepa- 
rated. □ 

Now we go back to the parameterized linear equation ( j^Tij ). Fix y 
and consider the vectors xo{y), ■ ■ ■ ,Xn-i{y) in Proposition 13.11 Then it is 
not difficult to see that their corresponding solutions xo{t,y) ■ ■ ■ 
are linearly independent. Thus for any solution x{t,y) of equation ( jgTTj ), 
there exist constants cq, • • • , Cn-i such that 

x{t,y) = coXo{t,y) H \- Cn-iXn-i{t,y), for all t eR. 

On the other hand, by making use of (i) of Proposition 13.11 for y ■ t, one can 
also obtain functions co(t), • • • , c„_i(t) such that 

x{t, y) = co(t)xoiy ■t)-\ h c„_i(t)x„„i(y • t). 

It then follows from ( jgT^ in Remark 13.21 that 

Cm{t) = Cm\xm{t,y)\, for m = 0, •••,n-l. (3.8) 
A direct calculation yields that 

I. x| _ xl,{t,y)B{y ■ t)xm{t,y) 
at \xm[t,y)\ 
and hence, by ( I3.8P , 

Cm{t) = >^m{y- t)Cm{t), (S-Q) 

where, 

^ / _ xl,{t,y)B{y ■ t)xm{t,y) 

Clearly, Xmiy) is continuous on Y for each 0<m<n — 1. As a consequence, 
we have decoupled ( j^TTj ) into system of 1-D equations (jj^j)- Moreover, by 
Theorem 13.31 we have following estimate of the growth rate of such linear 
equations. 

Corollary 3.6. Consider the linear skew product flow tt defined in ( j^T^ . 
Then there exist constants /3 > and 7 > such that 

r-t 

Xm+l{y ■ t) - Xmiy ■ T)dT < -^{t - s) + (3 



for any s < t and m = 0, ■ ■ ■ , n — 2. 
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Proof. This is a direct corollary from (jjjsj), dS-Sp and ( jgT^ . 



□ 



We end this section by constructing the relation between the Floquet 
bundles and the Sacker-Sell spectral bundles of ( j^TTj ). Recall that vr is the 
linear skew-product flow in (jj^j)- Let A G M and define Tr;^ : M x x y ^ 
M" X y by 

TTxit, X, y) = {^\{t, y)x, y ■ t), (3.10) 

where ^\{t, y) = e~'*'*$(t, y). It is easy to verify that vr^ is also a linear skew- 
product flow on M" X Y . We say ii\ admits an exponential dichotomy over Y 
if there is an invariant projector Q : M" x y — > x y, i.e. ^x{t,y)Q{y) = 
Q{y ■ t)^\{t,y) and positive constants K and a such that for all y ^Y , 

\^x{t,y){l-Q(y))\ < i^e-"*, t > 0, 
\<^x{t,y)Q{y)\ < i^e"*, t<0. 

^(y) = {A € M I fe.ioj ) has no Exponential Dichotomy over Y} is called 
the Sacker-Sell spectrum of (jsTij) (or ( jg^j )) on Y. Further, if Y is connected 
then its Sacker-Sell spectrum J20^) is of the form (See [201 [21]): J20^) — 
[ji=o[0'i,bi], where [aj,6j] are intervals and they are ordered from right to 
left, that is, ai-i < bi^i < a;_2 < bi-2 < • • • < «o < ^o- We hereafter denote 
by Vi the associated spectral bundle corresponds to the spectrum interval 
[oj, bi], for i = 0, - ■ ■ ,1 — 1, that is, 

Vi{Y) = {{x, y) G M" X y | \<^{t, y)x\ = o(e">~*) as t -00, 

\^{t, y)x\ = o{e^i^) as t 00}, 

where a^", bf are any numbers such that a~ < ai < bi < bf . With these 
notations we present a more delicate decomposition of Vi{y). 

Corollary 3.7. Fix < i < / - 1. Then 

Vi{Y) = Wn+i{y) e • • • e Wn+m{y), 

where N = dim(Vb(y) • • • ^i-i(y)) -I, M = dimyi(y). 

Proof. Fix Q < i < I — 1. Note that the ordered spectral bundle pair 
{Vo{Y)®- ■ ■®Vi^i{Y),Vi{Y)®- ■ ■®Vi-i{Y)) is exponentially separated over 
y, with dim(Vo(^)©- ■ ■®Vi-i{Y)) = N+l. On the other hand, by Theorem 
13.31 the ordered pair {Wq^n{Y), WN+i,n-i{Y)) is also exponential separated. 
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By uniqueness (see Lemma [33]) , we obtain that Vo{Y) © • • • © Vi-i{Y) = 
Wo^n{Y) and Vi{Y) © ••• © Vi_i{Y) = WN+i,n-i{Y). Similarly, we can 
also show that Vo{Y) © • • • © Vi{Y) = Wo,N+MiY) and Vi+i(Y) © ■ ■ ■ © 
Vi-i{Y) = WN+M+i,n-i{Y). Consequently, V,{Y) = {Vo{Y)®- ■ ■®V^{Y))n 
{Vi{Y) © • • • © Vn-l{Y)) = Wo,N+m{Y) n WN+l,n~l{Y) = Wn+i{Y) © • • • © 

Wn+m{Y). □ 

When there exists 1 < k < I — 1 such that 6^ < < a^^i, then vr itself 
admits an exponential dichotomy over Y. Let V'^{y) = Vo{y) © • • • © Vk{y), 
V'^{y) = Vk+i{y) © • • • © Vi-i{y). V^{y) and V^{y) are called unstable space 
and stable spaces of ( jgTTj ) at y G y, respectively. By virtue of Corollarv 13.71 
one has 

a{x) < dimy''(y) - 1, for x € ^"(y) n A, 

(3-ii) 

a{x) > dim. V^iy), ior x e V (y) n A, 

for each y ^Y. 

Finally, we give the following Lemma due to the continuity of V^'^{y) 
with respect to y, which will be useful in the next section. 

Lemma 3.8. Take any yi,y2 G Y. If the distance d{yi,y2) is sufficiently 
small, then V'''^{yi) © F"''(y2) = M". 

Proof. Let Q{y) be the projections on V^{y) along V'^{y). Since Q is con- 
tinuous about y, V^{y) = Q{y)W"-,V'^{y) = (1 — Q{y))M."' vary continuously 
with respect to y. Suppose that there are two sequence {yf }, {y2 } ^ sat- 
isfying d{yi, y2 ) as n oo, such that l^'^(y") fl y"(y2 ) 7^ {0} for any n. 
Without loss of generality, one may assume that y" — > y* as n ^ oo for any 
i = 1,2. Then we can choose unit vectors Wn G y^iUi) H ^"(yg )• By letting 
n — )• oo, the continuity of V^'^{y) with respect to y implies that there is a unit 
vector w G y^(y*)nF"(y*) = 0, a contradiction. Thus, we have proved that, 
for yi, y2 G Y with d{yi,y2) sufficiently smah, V^{yi) fl V^{y2) = {0}. Note 
also that V''{y2) © l^"(y2) = and dimy"(y2) = dimy(yi), we obtain 
that V'iyi) © F"(y2) = M'^. Similarly, one can prove ^"(yi) © F^(y2) = M" 
provided that d{yi,y2) sufficiently small. □ 
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4 Nonlinear cooperative-competitive tridiagonal sys- 
tems 



In this section, we will apply the Floquet theory obtained in the previous sec- 
tions to investigate the lifting property of w-limit sets of the nonautonomous 
tridiagonal system ([TTTJ)-|-([TTg). 

As we mentioned in the introduction, system ([iTT])+([TTnj) can be embed- 
ded into a skew-product flow : M" x H{f) ^ M" x H{f), 

Ut{xo,g) ^ {x{t,xo,g),g -t), (4.1) 

where x{t,xo,g) is the solution of 

±1 = gi{t,xi,X2), 

Xi = gi(t,Xi-i,Xi,Xi+i), 2<i<n-l; (4.2) 

Xn — 9n Xn—li Xn), 

with x{0;xo,g) = xq G M", and g = {gi, • • • ,gn) S H{f). It is also easy to 
check that the following two properties: 

(Gl) g is C^-admissible; 

(G2) -^>eo, ^^>eo, 1 < i < n - 1, (t, x) e M x R", 
oxi+i dxi 

hold for each g G H{f). 

Remark 4.1. For any g G H{f), Let x{t,xi,g) and x{t,X2,g) be distinct 
solutions of (gr^ on M. If we write x{t) = x{t,xi,g) — x{t,X2,g), then 
Lemma l2.ll holds for such x{t), in which the element aij{t) of the matrix- 
valued function A{t) can be written as 

a-ijit) = J -T)xit,xi,g) +Tx{t,X2,g))dT. 

In this section, we will assume that / is time-recurrent (i.e., the time 
translation flow {H{f),M), {g,t) >—^g-t for g G H{f) and t G M is minimal). 
This is satisfied, for instance, when / is a uniformly almost periodic or, 
more generally, a uniformly almost automorphic function, whose definition 
is given as follows. 

Definition 4.2. (1) A function / G C(IR, M") is almost periodic if, for any 
e > 0, the set T{e) := {r : + r) - f{t)\ < e, Vt G M} is relatively 
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dense in M. / is almost automorphic if for any {t^} C M there is a 
subsequence {t„} and a function (7 : M ^ such that f{t+tn) — ?• 
and — tn) —7- /(t) hold pointwise. 

(2) A function / G C(M x C M'") is uniformly almost periodic 

or uniformly almost automorphic in t if f{t,u) is bounded and uni- 
formly continuous on M x for any compact subset K C D, (i.e., / 
is admissible), and is almost periodic or almost automorphic in t G M. 

A subset K cW^x H{f ) is invariant if Tit{K) = K for every t G M. A subset 
K C X H{f) is called minimal if it is compact, invariant and the only non- 
empty compact invariant subset of it is itself. Denote by p : M" x H[f) — t- 
H{f), (xq, g) g the natural flow homomorphism. An invariant compact 
set K C X H{f) is called an almost 1-cover (resp. 1-cover) of H{f), if 
p~^{g) n -fT is a singleton for at least one g G H(f) (resp. for any y G Y). 

The following results, adopted from [29], have already showed the struc- 
ture of general minimal sets and w-limit sets of (j47Tj). 

Lemma 4.3. (i) // C M" x H{f) is a minimal set of (g^j), then E is 
an almost 1-cover of H{f); 

(ii) Let Ei,E2 be two minimal sets of ( [471] ). Then for any {xi,g) G Ei,i = 

1, 2, one has a{x{t, xi,g) — x{t, X2,g)) = const for all t G M. 

(iii) Any oj-limit set of ( j^TT] ) contains at most two minimal sets. 

Proof. See [29^ Lemma 4.2, Theorems 3.6 and 4.4]. □ 

Motivated by the work of Shen and Yi [25\ [26] , we will utilize the ob- 
tained Floquet theory in Section [3] to improve the lifting property of the 
w-limit sets which are hyperbolic (see Definition 14.41 below) . 

Let Y C M"' X H(f) be a compact invariant set of ( j^TTj ). For each 
y = {xo,g) G Y, consider the linearized equation of (gT^j) along the orbit 
y-t = I[t{xo,g): 

i = B{yt)z, t gM, zGM", (4.3) 

where B(y ■ t) = Dg{t,x{t,XQ, g)) is a matrix-valued function and of coop- 
erative tridiagonal form. 

Definition 4.4. A compact invariant set Y C M" x H{f) of (gTij) is called 
hyperbolic if (jjTsj) admits an exponential dichotomy over Y and the corre- 
sponding projection Q satisfies lmQ{y) ^ {0} for all y €Y. 
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Now we are ready to state our main result as follows. 

Theorem 4.5. Consider an ui-limit set a;(xo, go) C x H{ f) of (xq, go) G 
R" X H{f). If uj{xo, go) is hyperbolic, then it is a 1-cover of H{f). 

Theorem 14.51 immediately follows the lifting-property of hyperbolic omega- 
limit sets of two-dimensional competitive or cooperative systems: 

ColroUary 4.6. Consider the two-dimensional nonautonomous competitive 
fresp. cooperative) system 

Xl = fl{t,Xl,X2), ^ ^ 

X2 = f2{t,Xi,X2), 

where f = (/i,/2) is a -admissible and time-recurrent function satisfying 
Qf. Qf. 

jr^{t,x) <-£o<0 (resp. -i^(t,x) > sq > 0), l<i^j<2, 

ij dj j (JfJb j 

for all {t,x) G M X M^. Let {x,g) G x H{f) be such that its orbit 
Ilt{x,g){t > 0) is bounded. If the omega-limit setuj{x,g) is hyperbolic, then 
u}{x,g) is a 1-cover of H[f). 

Remark 4.7. Theorem l4.5l is a natural generalization of the results of Smil- 
lie [27] and Smith [28j. Moreover, in a certain sense, it also extends to higher 
dimension (n > 3) the results in spatially homogeneous cases by Hetzer and 
Shen [H], who investigated the dynamics of two-dimensional competitive or 
cooperative almost periodic systems. In particular, Corollary 14.61 general- 
izes the results of de Mottoni and Schiaffino [TB] and Hale and Somolinos 
[6], who proved that all solutions of two-dimensional T-periodic competitive 
or cooperative systems are asymptotic to T-periodic solutions. See also [9] 
and |24] for extensions of this work. 

In order to prove our main results, we first proceed with the charac- 
terization of the integer- valued function a on the local invariant manifolds 
of hyperbolic invariant sets. Our approach is motivated by [25t I26j. How- 
ever, as mentioned in the introduction, we still need more delicate trick to 
overcome the difficulties that there is no direct characteristic for the critical 
phase-points which are not in A (See below the detail in the proof of Theo- 
rem 23]), while for the zero-crossing number, the standard characteristic of 
u{^) = Ux{i) = 0, for some ^, can be directly used to analyze such critical 
situation (see, e.g [25l Theorem 4.8]). 
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Let Y C X H{f) be a hyperbolic compact invariant set of ( j^TT] ). For 
any y = {xo,g) £ Y, let z = x — x{t,xo,g). Then z satisfies the nonhnear 
equation 

z = B{yt)z + G{z,yt), (4.5) 

where B{y ■ t) ia as in (gT^j) and G(z,y ■ t) = 0(|zp). Noticing that system 
(gr^j) admits an exponential dichotomy over Y, it follows from standard 
invariant manifold theory (see O El [251 130] ) that system (grgf possesses for 
each y £ Y a local stable manifold W^{y) and a local unstable manifold 
W^{y); and one can find a constant C > such that for any y £ Y and 
xs G Vr^(y), xu G l^^y), 

<Ce-(°/2)*|3;^| fort>0, 

where ^t{',y) is the solution operator of ( j^T5j ). Moreover, they are overflow- 
ing invariant in the sense that 



^t{W'iy),y) ^W%yt) for t » 1, 
y) C . t) for t < -1. 



(4-7) 



Now for each y = (xq, 5) G 5^, we define 



M"(y) ^{x£ M"|a; - xq G W^'(y)}, 
M"(y) ^ {x G M"|x - xo G 

Then M^{y) and M'^(y) are overflowing invariant to (gT^, that is 

x{t,M'{y),g) C M'{y -t) for t » 1, 
x(i,M"(y),c/) C M"(y -t) for t < -1. 

We also note that if Y is moreover connected then dim M^''^{y) = dim T^"'^(y) 
are positive integers independent of y G here V^'''{y) are the unsta- 
ble/stable subspace of (gTjj) defined in the end of last section. 

Lemma 4.8. Let Y C M" x H{f) he a connected compact hyperbolic invari- 
ant set of (gTij). Then, for {xi,g), {x2,g) G Y with |xi — X2I being sufficiently 
small, one has M''{xi,g) nM"(x2,5) / 0. 

Proof. By the standard invariant manifold theory (see [31 \7\ [251 [30]), for 
each y = {xo,g) G Y, there are functions h^{-,y) ■ V^{y) — >■ V'^{y) 
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and /i"(-,y) : ^"(y) ^ V'{y) such that h''''{z,y) = o{\z\), 
z,y)\ < Co < 1 ior ze V'''^{y), and 

M^y) = xo + W'{y) = {xo + + h'{x\y)\x' G V%y) n BsAxo)}, 

M-{y) = xo + = {xo + x« + /i"(x«,y)|x" G n ^^.(xo)}, 

where BsX^o) = {x G W" : |x — xo| < 5*} for some 5^ > 0. 

By Lemma FS-Sl one can find a small 6i G (0, 5*) such that if |xi — X2I < Si, 
then V^{xi,g) © ^"(2:2,5) = IK"- For such xi and X2, define a function 
fc: (xi,X2,F^(xi,5)©V^"(x2,5)) ^IK", by 

A;(xi,X2,xJ,x^) = xi + xj + /i'*(x?,(xi,5r))-(x2 + x^ + /i"(x^,(x2,5))) (4-8) 

for any xf G ^'^(xi,^) and xf G V^{x2,g)- 

Note that /c(x,x,0, 0) = and dk/dxl = I + dh"^ /Oxf is invertible. By 
implicit function theorem, one can find a 5 G {0,5i) such that, for each 
xi,X2 G M" with |xi — X2I < S and X2 G y"(x2,5') with |x2| < 5, there 
is a unique xf G V^{xi,g) with |xf[ < 5 such that fc(xi, X2, xf , x|) = 
holds. Therefore, by ( |4.8p and the representation of M'^'"(y) in the above, 
one obtains that M^{xi,g) fl M^{x2,g) 7^ whenever |xi — X2I sufficiently 
small. We have completed the proof. □ 

Theorem 4.9. Let Y C M" x H{f) be a connected compact hyperbolic in- 
variant set of (jjTij). Denote N = dim M"(y). Then for any y = {xQ,g) G Y 
and X* G iVP(y)\{xo} (resp. x" G M"(y)\{xo}J, one has a{x'^ — xq) > N 
(resp. cr(x" — Xo) ^ N — 1), whenever x'^ — xo G A (resp. x" — xo G Aj. 

Proof. We prove only for the unstable case and the stable case is similar. 

For any y = (xo,g) and x" G M"(?/)\{xo}, let x(t) = x{t,x'^,g) — 
x{t,xo,g). Since x(0) = x" — xq G W'^{y), we have x{t) G l^"(y • t) for 
t <C — 1 by d^TTj ), and hence 



for t <C —1, where Xo(x(t),y-t) G y"(y-t) and /i" is the C^-function defined 
in the proof of the above Lemma. Choose any sequence tn ^ —00 such that 
y ■ tn y* = {x*,g*). By virtue of the contracting property of W^{y ■ t) in 
the reverse time, it follows that 



x(t) = x^{x{t),y • t) + /i"(x^(x(t), y ■t),y t) 




lim ''"0 (■^(^")' y ' 

n^oo |x^(x(t„),y • tn)\ 



X* G y"(y*). 
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Let $ be the principal solution matrix of ( |^T^ „, (i.e., ( j^T^j ) with y replaced 
by y*). Then <I>(t,y*)x* is a solution of ( j^T^ ,,, . Moreover, for each t E 
R, one has x(t + + t„)| <^{t,y*)x* /\<^{t,y*)x*\ as n ^ oo. By 

Lemma YlA\ there exists a to < such that ^{tQ^y*)x* € A. Consequently, 
x{tQ + G A and (j{x{tQ = (T{(^{tQ,y*)x*) for all n sufficiently large. 

Note also that (^{to,y*)x* G • to)- Then by ( jgTTT] ), one obtains that 

cr(a;(to + tn)) < — 1 for all n sufficiently large. 

Now recall that x{t) = x{t,x^,g) — x{t,xo,g). By virtue of Remark 14.11 
(hence Lemma 12.11 holds for such x{t)), we have o"(x" — xq) = a{x{0)) < 
a{x{to + tn)) < N — 1, whenever — xq G A. Thus we have completed the 
proof. □ 

Definition 4.10. Assume that Y C M" x H{f) is a compact invariant set 
of (gTij). A pair {xi, g), {x2, g) G 1^ is said to be one-sided fiber distal if 
infteR+ \x{t,xi,g) - x{t,X2,g)\ > or infjgR- \x(t,xi,g) - x{t,X2,g)\ > 0. 

Lemma 4.11. Let Y C M" x H{f) be a connect and compact hyperbolic 
invariant set of ( j^TT] ) . Then all pairs in Y are one-sided fiber distal. 

Proof. Suppose that there is a pair {{xi,go), {x2,go)} G Y with 
inf \x{t,xi,go) - x{t,X2,go)\ = 0. 

tGK± 

By virtue of Remark 14. H there exists some to S 1^ such that x{tQ, xi, go) — 
x{tQ,X2, go) G A. Then we can choose an eq > so small that x{to,xi,go) — 
x{to,X2,go) + X G A; and moreover, 

a{x{to,xi,go) - x{to,X2,go) + x) = a{x{to,xi, go) - x{to,X2,go)) (4-9) 

whenever x G with \x\ < eq. Choose two sequences t^ — > oo, s^ — >■ — oo ( 
k — 7> oo) such that 

\x{tk,xi,go) - x{tk,X2,go)\ 

and 

\x{sk,xi,go) - x{sk,X2,go)\ 0, 

as A: — >■ oo. Consequenctly, Lemma 14.81 implies that for each k sufficiently 
large, one can find 

x\ G M' {x{tk,xi,go), go ■ tk) r\ M''{x{tk,X2, go), 90 ■ tk) 



24 



and 

x^i G M^{x{sk,xi,go),go • Sfc) n M"(x(sfc, 2:2, £/o), 9o • Sfc). 

Using the fact of G M''{x{tk,X2, go), go-tk), x^_ G M''(x(sfc, xi, go), 5o -Sfc) 
and ( I4.6P , we readily get 

|x(s,x+,go • ifc) - x{s,x{tk,X2,gQ),go ■ tk)\ < Ce("/^)*|x+ - x{tk,x2,go)\, 
\x{t,x'L,go ■ Sk) - x{t,x{sk,xi,go),go ■ Sk)\ < Ce~("/^)*|x^ - x{sk,xi, go)\, 

for any s < 0, t > and k sufficiently large. In particular, we choose 
s = to — tk < and t = to — Sk > 0. Then one can find some ko sufficiently 
large such that 

\x{to - tko,J+,go ■ tfco) - x{tQ,X2,go)\ < eo 

and 

\x{to - Sfco>3;!°,5o • Sko) - x{to,xi,go)\ < eo- 

Hence, by (grgj), 

a{x{to,xi,go) - x{to,X2,go)) 
=a{x{to,xi,go) - x{to,X2,go) 

+ x{to,X2,go) -x{to -tko,x^,go -tko)) 
=a(x{to,xi,go) - x{to - tko,x'^,go ■ tko)) 
>(j{x{tka,xi,go) - x^") 

where the first inequality comes from Remark 14.11 and Lemma I2.ir ii) , and 
the last inequality is due to G M*(x(tfc„, xi, (70); 50 ■ ^fco) ^"^^ Theorem 
14.91 Similarly, one can also obtain that 

a{x{to,xi,go) - x{to,X2,go)) 
=a{x{to,xi,go) - x{to,X2,go) 

+ x{to - Sko,x^°,go ■ Sko) - x{to,xi,go)) 
=(7{x{to - Sko,x^_^\go ■ Sko) - x{to,X2,go)) 
<(7{x{sko,x2,go) - a;^?) 
<N - 1, 

where the last inequality is due to x^° G M^{x{sko, X2, go), do ' Sko)- Thus we 
have obtained a contradiction, which implies that any pair in Y is one-sided 
fiber distal. □ 
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Proposition 4.12. Let E C M" x H{f) he a hyperbolic minimal set of (j5TT|. 

Then E is a 1-cover of H{f). 

Proof. Suppose that E is just an almost 1-cover (not a 1-cover) of H{f). 
Then it follows from minimality of H{f) that there is no one-sided fiber 
distal pair on E, which contradicts to Lemma |4. Hi □ 

Proof of Theorem 14.51 According to Proposition 14.121 it suffices to show 
that u}{xo,go) is minimal. To this end, we suppose that u{xo,go) is not 
minimal. Then Lemma I4.3f iii) implies that uj{xQ,go) can be written as 
w(a^O) go) = EiL) E2U E12, where Ei{i = 1, 2) are minimal sets (and hence, 
they are 1-covers of H{f) by Proposition 14.12]) . Since uj{x,g) is connected, 
E12 0. Moreover, for any {x,g) G E12, one has 

uj{x, g) n {El u ^2) / and a{x, g) n {Ei U E2) 7^ 0. (4.10) 

If El = E2, then we pick an {xi2,g) € -E12 and let {xi,g) = Ei r]p~^{g). 
By virtue of (gTinj), {xi2,g) and {xi,g) is not one-sided fiber pair, which 
contradicts Lemma 14.111 

If El 7^ E2, then again we pick an {xi2,g) G E12 and let {xi,g) G 
Ei r\p^^{g) for i = 1,2. Due to the same reason in the above paragraph, we 
may assume without loss of generality that uj{xi2, g)riEi ^ and a{xi2,g) H 
E2 7^ 0. Since Ei{i = 1,2) are 1-covers of H{f), it is easily seen that 
\x{t, xi2,g) — x{t,xi,g)\ as t ^ 00, and \x{t, xi2,g) — x{t,X2,g)\ ^ as 
t —00. As a consequence, x{t,xi2,g) G M'^(Ilt{xi,g)) for all t sufficiently 
positive, and x{t,xi2,g) G M'^(Ilt{x2, g)) for all t sufficiently negative. It 
then follows from Theorem 14.91 and Remark 14.11 that, for any t G M, 

a{x{t,xi2,g) - x{t,xi,g)) > N, (4.11) 

whenever x{t,xi2,g) — x{t, xi, g) G A, and 

a{x{t,xi2,g) - x{t,X2,g)) < N - 1, (4.12) 

whenevei x{t,xi2,g)—x{t,X2,g) G A. Here N = dim M^{xi, g) = M'^{x2, g). 

As mentioned in Remark 14. Ij z{t) = x{t,X2,g) — x{t,xi,g) is a nontriv- 
ial solution of the linear equation i = B{t)z. Here B{t) = Dg{t, (1 — 
T)x{t,xi,g) + Tx{t, X2, g))dT, which is a cooperative tridiagonal matrix. 
Moreover, B{t) is bounded and uniformly continuous on R, because g is 
C^-admissible and {xi,g) G Ei with Ei being a 1-cover for i = 1,2. 
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Now we claim that there exist positive numbers T,5 > such that 

z{t) £ As = {x £A: dist(x, A'^) > 6} 

for all \t\ > T, where A'^ is the complement of A in R". Otherwise, there 
exists a sequence t„ — >• cxo (or t„ — t- — oo) such that 

dist(z(t„), A'^) as n oo. 

Note Xi G Ei, i=l,2. One can choose a subsequence still denoted by t„ such 
that x{tn,Xi,g) Wi G Ei. Let z^, = wi — W2 0. Then z{tn) — >■ z^, as 
n — 7> oo. Moreover, ^ A. By the boundedness and uniform continuity of 
B{t), we may assume without loss of generality that B{t + tn) converges to 
B^{t) uniformly on any compact interval of M. Then it follows from Lemma 
I2.5l that the solution z^{t) of i = B^{t)z, with initial value z*(0) = z^, satisfies 
Zif{t) G A for all t € M, a contradiction to z^, ^ A. Thus we have proved the 
claim. As a consequence, it entails that 

z(t)+yGA, (4.13) 

whenever \y\ < | and \t\ > T. 

Recalling that \x{t,xi2, g) — x{t,xi,g)\ — > as t ^ 00, it then follows 
from 04.111 ) and ( 14.131 ) that 

a(z{t)) = a{x(t,X2,g) - x{t,xi,g) +x{t,xi,g) - x{t,xi2,g)) 
= a{x(t,X2,g) - x{t,xi2,g)) 
<N-1, 

for all t sufficiently positive. On the other hand, by ( i4.i2j ) and (gTijj) one 
can similarly get that 

a{z{t)) = a{x{t,X2,g) - x{t,xi,g) +x{t,xi2,g) - x{t,X2,g)) 
= a{x{t,xi2,9) - x{t,xi,g)) 
>N, 

for all t sufficiently negative. Hence, we have obtained a contradiction to 
Lemma [4.3r ii). which completes the proof of the minimality of uj{xo, go). □ 
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